Developing a corpus of strategic conversation in The Settlers of Catan

International audienceWe describe a dialogue model and an implemented annotation scheme for a pilot corpus of annotated online chats concerning bargaining negotiations in the game The Settlers of Catan. We will use this model and data to analyze how conversations proceed in the absence of strong forms of cooperativity, where agents have diverging motives. Here we concentrate on the description of our annotation scheme for negotiation dialogues, illustrated with our pilot data, and some perspectives for future research on the issue

Volumetric optoacoustic neurobehavioral tracking of epileptic seizures in freely-swimming zebrafish larvae

Fast three-dimensional imaging of freely-swimming zebrafish is essential to understand the link between neuronal activity and behavioral changes during epileptic seizures. Studying the complex spatiotemporal patterns of neuronal activity at the whole-brain or -body level typically requires physical restraint, thus hindering the observation of unperturbed behavior. Here we report on real-time volumetric optoacoustic imaging of aberrant circular swimming activity and calcium transients in freely behaving zebrafish larvae, continuously covering their motion across an entire three-dimensional region. The high spatiotemporal resolution of the technique enables capturing ictal-like epileptic seizure events and quantifying their propagation speed, independently validated with simultaneous widefield fluorescence recordings. The work sets the stage for discerning functional interconnections between zebrafish behavior and neuronal activity for studying fundamental mechanisms of epilepsy and in vivo validation of treatment strategies

The DisHuman child

In this paper we consider the relationship between the human and disability; with specific focus on the lives of disabled children and young people. We begin with an analysis of the close relationship between ‘the disabled’ and ‘the freak’. We demonstrate that the historical markings of disability as object of curiosity and register of fear serve to render disabled children as non-human and monstrous. We then consider how the human has been constituted, particularly in the periods of modernity and the rise of capitalism, reliant upon the naming of disability as antithetical to all that counts as human. In order to find a place for disabled children in a social and cultural context that has historically denied their humanity and cast them as monstrous others, we develop the theoretical notion of the DisHuman: a bifurcated complex that allows us recognise their humanity whilst also celebrating the ways in which disabled children reframe what it means to be human. We suggest that the lives of disabled children and young people demand us to think in ways that affirm the inherent humanness in their lives but also allow us to consider their disruptive potential: this is our DisHuman child. We draw on our research projects to explore three sites where the DisHuman child emerges in moments where sameness and difference, monstrosity/disability and humanity are invoked simultaneously. We explore three locations – (i) DisDevelopment; (ii) DisFamily and (iii) DisSexuality – illuminating the ways in which the DisHuman child seeks nuanced, politicized and complicating forms of humanity

Representing 3D Space in Working Memory: Spatial Images from Vision, Hearing, Touch, and Language

The chapter deals with a form of transient spatial representation referred to as a spatial image. Like a percept, it is externalized, scaled to the environment, and can appear in any direction about the observer. It transcends the concept of modality, as it can be based on inputs from the three spatial senses, from language, and from long-term memory. Evidence is presented that supports each of the claimed properties of the spatial image, showing that it is quite different from a visual image. Much of the evidence presented is based on spatial updating. A major concern is whether spatial images from different input modalities are functionally equivalent— that once instantiated in working memory, the spatial images from different modalities have the same functional characteristics with respect to subsequent processing, such as that involved in spatial updating. Going further, the research provides some evidence that spatial images are amodal (i.e., do not retain modality-specific features)

Data-based analysis of speech and gesture: the Bielefeld Speech and Gesture Alignment corpus (SaGA) and its applications

Lücking A, Bergmann K, Hahn F, Kopp S, Rieser H. Data-based analysis of speech and gesture: the Bielefeld Speech and Gesture Alignment corpus (SaGA) and its applications. Journal on Multimodal User Interfaces. 2013;7(1-2):5-18.Communicating face-to-face, interlocutors frequently produce multimodal meaning packages consisting of speech and accompanying gestures. We discuss a systematically annotated speech and gesture corpus consisting of 25 route-and-landmark-description dialogues, the Bielefeld Speech and Gesture Alignment corpus (SaGA), collected in experimental face-to-face settings. We first describe the primary and secondary data of the corpus and its reliability assessment. Then we go into some of the projects carried out using SaGA demonstrating the wide range of its usability: on the empirical side, there is work on gesture typology, individual and contextual parameters influencing gesture production and gestures’ functions for dialogue structure. Speech-gesture interfaces have been established extending unification-based grammars. In addition, the development of a computational model of speech-gesture alignment and its implementation constitutes a research line we focus on